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FOREWORD 


This  report  covers  the  actions  that  have  transpired  during  the  fifth 
year  of  Project  ABACUS,  the  Army's  program  for  the  development  of  a 
prototype  Computerized  Training  System.  It  includes  a  narrative 
summary,  key  documents,  and  amplifying  annexes. 

As  a  historical  document,  it  will  be  utilized  in  preparation  of  the 
final  project  report.  It  is  also  meant  to  provide  the  current  reader 
with  an  understanding  of  the  progress  to  date  of  Project  ABACUS,  its 
present  position,  and  what  actions  are  anticipated  to  be  completed  in 
the  near  future. 


Program  Director,  Project  ABACUS 
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I.  INTRODUCTION 

The  mission  of  Project  ABACUS  is  to  design,  develop,  test  and  evaluate 
a  128-terminal  Computerized  Training  System  (CTS) ,  utilizing  the  multi¬ 
minicomputer  concept.  At  the  conclusion  of  5  years,  the  project  is 
in  the  test  and  evaluation  phase. 

II.  BACKGROUND 

The  events  leading  to  the  implementation  of  the  CTS  project  and  the 
progress  through  the  first  4  years  are  documented  in  annual  status 
reports  and  are  listed  at  Annex  J.  The  Product  Manager  Charter  and 
DA  Management  Plan  were  reviewed  as  required  on  the  project's  anniver¬ 
sary  date,  1  August  1976.  There  were  no  changes  made  to  either 
document . 

A  new  Memorandum  of  Understanding  (MOU)  between  the  Commander,  US  Army 
Training  Support  Center  (ATSC)  and  the  Commandant,  US  Army  Signal 
School  (USASIGS)  was  negotiated  and  signed  by  both  parties  on  17  May 
1977  and  23  May  1977,  respectively.  A  copy  of  the  MOU  is  at  Annex  A. 

III.  PERSONNEL  AND  ORGANIZATION 


There  has  been  a  reorganization  of  the  Communicative  Technology 
Directorate  (CTD),  Ft  Eustis,  Virginia,  into  two  divisions;  the 
Media  Applications  Division  and  the  Systems  Design  Division.  The  Test 
Branch  is  an  element  of  the  Systems  Design  Division.  Mr.  Donald 
Kimberlin  was  transferred  to  the  CTD  as  the  Chief,  Media  Applications 
Division  effective  June  1977.  LTC  Robert  Foster  remained  as  Program 
Director,  Project  ABACUS  and  assumed  the  duties  of  Chief,  Test  Branch 
on  the  transfer  of  Mr.  Kimberlin.  The  present  organizational  relation¬ 
ships  are  illustrated  at  Annex  B. 
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The  staffing  of  the  Test  Branch  at  Fort  Gordon,  Georgia  consists  of  six 
military  and  three  civilians.  One  of  the  civilians  will  be  transferred 
to  the  Media  Applications  Division  at  Ft  Eustis,  Virginia  in  August 
1977.  During  the  past  year,  as  vacancies  occurred  thru  normal  attrition, 
the  spaces  in  the  Test  Branch  have  been  transferred  to  ATSC,  Ft  Eustis, 
Virginia.  This  has  been  consistent  with  the  decreasing  workload  as  the 
project  nears  completion.  A  roster  of  personnel  is  at  Annex  C.  The 
organizational  relationship  between  USASIGS  and  Project  ABACUS  is  at 
Annex  D. 
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IV. 


COMPUTER  SYSTEM 


A.  Summary  of  Procurement.  The  following  is  a  summary  of  the 
major  procurement  actions  that  have  been  initiated  or  completed  during 
the  fifth  year  of  the  project.  A  summary  of  major  procurement  actions 
thru  the  first  4  years  is  at  Annex  E. 

1.  October  1976  -  System  passed  the  Phase  III  Acceptance 
Test  and  was  accepted  by  the  Government. 

2.  May  1977  -  Maintenance  contracts  were  negotiated. 

3.  May  1977  -  Modification  to  RSX-11  ordered  to  provide 
real  time  operational  capability. 

B.  Status . 

1.  The  Human  Resources  Research  Organization  (HumRRO)  was 
placed  under  contract  to  conduct  the  acceptance  testing  of  the  system 
for  the  Government.  A  three  phase  acceptance  test  was  prepared  for 
the  system  and  executed.  Phase  III  was  successfully  run  during  the 
period  19-30  July  1976  after  two  previous  failures.  The  contractor, 
GTE-Sylvania,  resolved  several  shortcomings,  problems,  and  discrepancies 
to  the  satisfaction  of  the  Contracting  Officer's  Technical  Representative 
(COTR),  LTC  Robert  Foster.  After  the  delivery  and  acceptance  of  the 
final  reports  from  GTE-Sylvania  and  HumRRO,  the  system  was  accepted 

for  the  Government  on  22  October  1976.  These  reports  are  listed  at 
Annex  J. 

2.  The  system  maintenance  contract  with  GTE-Sylvania  was 
scheduled  to  expire  31  December  1976.  The  delays  in  processing  new 
maintenance  contracts  resulted  in  extensions  of  the  existing  contract 
until  May  1977.  New  contracts  were  awarded  effective  1  May  1977. 

These  contracts  cover  the  period  May  1977  to  September  1979.  The 
Government  has  two  1  year  renewal  options  beginning  1  October  1977. 

Two  companies  were  awarded  the  maintenance  contracts.  Engineering 
Services  Corporation,  San  Diego,  California  was  awarded  the  contract 
to  maintain  the  central  processors  and  peripheral  equipment. 

International  Computer  Equipment,  Incorporated,  Atlanta,  Georgia  won 
the  contract  to  maintain  the  terminals,  terminal  interface  equipment, 
and  video  transmission  amplifiers. 

V.  COURSE  DEVELOPMENT 

A.  Current  Status.  Course  development  has  continued  to  progress 
at  an  uneven  pace.  The  courses  were  scheduled  for  implementation 


relative  to  system  acceptance  (D-day).  "’lie  DD  Form  250  accenting  tbr 
system  for  the  Cf"»ernsent  was  signed  by  the  Contracting  Officer's 
Technical  Representative  on  22  October  1976.  The  implementation  of 
the  courses  is  as  follows: 


Course 


Programmed 

Implementation* 


Implementation** 


31E20 

35L20 

31J20 


TH-90  (29  Jan  77) 
P+150  (30  Mar  77) 
TH-180  (29  Aor  77) 


10  Jan  77/5  .Tul  77 

11  Apr  77/1  Oct  77 
11  Jill  77/1  Nov  ~7 


*  1  November  197t  established  as  D-dav 
**Initial  implem^ntation/Ful]  implementation 

The  reprogrammed  implementation  dates  wore  established  in  rsplv  to  * 
message  to  Commandant.  ’15 ASICS  from  the  Commander,  ATSC .  A  copy  of 
this  corresnondonco.  is  at  Annex  F. 

Pi.  Problems  Encountered. 


1.  The  significant  facto*-  affecting  the  progress  of  the  31520 
MOS  course  has  been  the  re-allocation  of  personnel  available  for  course 
development.  The  two  instructional  programmers  provided  to  the  USASTG" 
by  the  Test  Branch,  ATSC  were  transferred  from  ATSC.  One  instruction'’' 
programmer  was  transferred  by  Department  of  the  Army  orders  in  December 
1976  to  duty  as  a  drill  sergeant,  and  the  other,  a  civilian,  accepted 
a  position  within  1TSASICS  in  April  1977.  It  was  determined  that  the 
advanced  state  courseware  n reparation  n»-»de  if  impractical  to 
requisition  repie 'ement  personnel.  Initially,  USASIG3  designated 
five  individuals  ■>«:  MOf,  as  instructional  programmers  for  course 
development.  Dur ■ ng  the  period  of  this  report,  three  instructional 
programmers  were  assigned,  and  on  occasions  as  annexes  were  imnlemen'e'1 
and  student  load  ’’ncreasod.  on  1  v  one  remained  full  time  in  course 
development . 


2.  The  53L20  MOS  course  development  effort  has  had  only  two 
instructional  programmers  assigned  for  “he  past  vear.  For  several 
months  a  ”p«t  Branch  instructional  programmer  was  si-,-*  f  t-.-»d  crrr  t>*o 
31E2G  course  to  nuo-nent  the  381.29  dove  *  or  me- 1  effort. 

7.  T  e  1  j.!2°  -8  -o'l-ar  bo-  c  s  1  '  !  v  maintained  a  ruii 

of  course  development  ne-snnnel ,  four,  for  the  oast  vear.  The  Tcs* 
Branch.  ATSC  has  kept  the  same  personnel,  one  military  and  one 
civilian,  assigned  since  late  1974.  However,  the  civilian  from  the 

^"Fourth  Year  Status  Report,  Computerized  Training  System.  Proiect 
ABACUS,"  1  Aug  76,  p.4. 
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Test  Branch  is  scheduled  for  transfer  to  ATSC,  Fort  Eustis,  VA  in 
August  and  will  not  be  replaced.  There  have  been  a  number  of  changes 
in  the  Program  of  Instruction  (POI).  An  approved  POI  was  finally 
implemented  in  July  1977.  This  instability  has  caused  a  significant 
amount  of  rewriting  and  reprogramming. 

VI.  SYSTEMS  AND  APPLICATIONS  PROGRAMMING 


Current  Status.  The  systems  and  applications  programming 
effort  is  completed  with  the  exception  of  two  programs.  These  are 
the  question  and  test  analysis  runs.  Just  prior  to  completion  of 
these  two  programs,  a  major  file  restructuring  was  required  to 
accommodate  the  large  amount  of  data  being  generated.  These  two 
programs  are  being  entered  into  the  system  and  are  scheduled  to  be 
operational  by  the  end  of  August  1977.  The  continuing  programming 
effort  for  Project  ABACUS  will  be  to  prepare  final  documentation  and 
continue  program  maintenance.  The  USASIGS  hired  a  civilian  in  June 
and  assigned  him  to  application  programming  for  the  CIS  preparatory 
to  the  USASIGS  takeover  of  the  system  after  the  evaluation. 

VII .  PROJECT  EVALUATION 

A.  Final  Evaluation  Report.  A  contract  to  perform  the  final 
evaluation  of  the  prototype  CTS  and  to  provide  guidance  to  training 
directors  on  the  subject  of  training,  technical  and  cost  effective¬ 
ness  and  associated  benefits  in  support  of  self-paced  training  courses 
and  management  of  instruction  was  awarded  HumRRO,  27  July  1977. 

HumRRO  will  coordinate  the  evaluation  with  Test  Branch  personnel.  The 
milestone  chart  is  at  Annex  G.  The  final  report  is  scheduled  for 
delivery  the  end  of  May  1978. 

B.  The  Computer  Systems  Support  and  Evaluation  Agency  conducted 
a  hardware  technical  evaluation  of  the  ABACUS  system  using  system 
monitors.  The  report  of  this  evaluation  is  at  Annex  H. 


Course  Implementation. 


1.  The  Field  Radio  Repair  Course,  MOS  31E20,  implemented  the 
CTS  in  January  1977.  Implementation  began  in  the  last  training  annex 
of  the  course  and  has  progressed  satisfactory  toward  the  front  end  of 
the  course.  One  shift  operation  of  the  entire  course  commenced  in 
July  1977.  Second  shift  operation  is  scheduled  for  August  1977. 

The  course  is  operating  in  the  Computer  Managed  Instructional  (CMI) 
mode.  This  is  a  hard-skill  course  using  the  functional  hands-on 
training  concept;  therefore,  very  little  Computer  Assisted  Instruction 
(CAI)  is  used.  However,  there  is  extensive  on-line  testing. 
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a.  The  current  POI  was  implemented  August  1976,  using 
self-pacing  as  the  method  of  instruction.  In  January  1977,  the  CTS 
was  implemented,  using  the  computer  as  a  CMI  tool.  Less  than  10% 

CAI  is  utilized  in  this  course.  In  April  1977,  a  major  change  to  the 
POI  occurred  when  training  on  the  AN/GRC-46  was  implemented. 

b.  Data  collection  for  comparative  purposes  is  very 
difficult  in  this  c~  ’rse  due  to  its  dynamic  status. 

2.  The  Teletypewriter  Equipment  Repair  Course  (MOS  31J20) 
implemented  a  new  POI  8  August  1977  with  seven  students.  POI  time 
within  the  course  was  changed  to  accommodate  additional  equipment 
training.  CTS  is  scheduled  to  be  implemented  in  August  1977,  with  the 
entire  course  scheduled  to  be  using  CTS  in  November  1977. 

3.  The  Avionics  Communication  Equipment  Repair  Course 
(MOS  35L20)  implemented  a  new  POI  April  1977.  This  POI  resulted 

in  extensive  changes  to  the  internal  makeup  of  the  course,  due  to  the 
addition  and  deletion  of  equipments.  It  is  anticipated  that  by 
September  1977  approximately  50%  of  the  course  will  be  on-line  with 
the  entire  course  scheduled  to  be  in  operation  by  October  1977. 
Validation  of  CTS  is  progressing  satisfactory,  and  a  few  students 
have  completed  the  course  using  CTS  in  a  CMI  mode. 

D.  Data  Collection  Status  . 

1.  The  Field  Radio  Repair  Course  (MOS  31E20)  POI  implemented 
in  August  1977  resulted  in  a  number  of  changes  between  the  old  and  new 
POI.  This  invalidates  a  significant  amount  of  baseline  data  that  could 
have  been  used  for  a  comparative  evaluation. 

a.  Data  was  collected  during  the  period  September  1976 
thru  December  1976  on  the  students  undergoing  self-paced  training. 

A  total  of  59  samples  were  collected  on  Electronics  (EL)  and  General 
Technical  (GT)  aptitutde  scores  and  progression  indices2  of  each  task. 

b.  During  the  period  January-March  1977,  85  samples 
were  collected  on  CTS  training.  It  must  be  emphasized  that  CTS  was 
implemented  in  January,  and  this  data  could  easily  change  as  more 
instructors  and  course  people  become  more  effective  in  using  the 
computer  as  a  media.  Tasks  1,  2,  and  3  were  still  using  self-pacing 
when  this  data  was  collected.  A  comparison  of  data  collected 
September  1976-March  1977  (self-paced  training)  and  data  collected 
January-March  1977  (part  self-paced  and  new  CTS  training)  is  at 
Annex  I . 

2Progression  indices  -  A  score  of  1.00  indicates  completion  of  that 
training  in  the  allocated  time.  A  score  of  .80  indicates  completion 
in  80%  of  the  allocated  time. 


2.  Mo  task  comparative  data  is  available  on  the  Tele¬ 
typewriter  Equipment  Repair  Course  (MOS  3U201.  Data  collection, 
for  comparative  purposes,  comncrroii  with  the  implementation  of  the 
new  POI,  8  August  ID 77. 

3.  Comparative  data  is  incomplete  on  the  Avionics 
Communication  Eouinrv.nt  Repair  Course  (35L20). 

E .  Opinion  Questionnaires  . 

1.  The  fell  owing  opinion  nuest i onnaires  have  been 

administered : 

a.  8 r ud r. *■  art  it ade,  self-paced  Instruction. 

b.  Instructor  survey ,  self-paced  instruction. 

c.  Staff  and  faculty  survey,  self-paced  instruction. 

d.  Instructional  programmer  survey,  CTS. 

e.  Course  materials  development  survey,  CTS. 

2.  Opinion  questionnaires  to  he  administered  are  as  follows 

a.  Student  attitude  questionnaire,  CTS. 

b.  rnsrr'.*..tor  su’*"',v,  CTS. 

c  .  St.af and  faculty  survey,  CTS. 

d.  Instructional  materials  survey ,  CTS. 

e.  Operational  reports  survey,  CTS. 

f.  Praourn"  n' location  survey.  CTS. 

g .  i n •••  r ruo t  :■  op,i  1  process  survev ,  CTS. 

h.  Per ;  sen  .in.:  alternate  training  materials  survev,  CTS 

•i .  i ■,!  in'  p  ■*'  c-t  id. -or  records  survev,  CTS. 

;  .  re; ,'-rv  r>:  -nu-yev ,  CTS  . 

'  .  ~  d-  i'TS. 

r  •  :  •>  ■  ,!||>-u —  survey ,  CTS. 
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ANNEX  H 


DEPARTMENT  OF  THE  ARMY 

U  S.  ARMY  COMPUTER  SYSTEMS  SUPPORT  AND  EVALUATION  AGENCY 
WASHINGTON.  D.C.  20310 


£  (  £PP  :gj7 


SUBJECT:  Report  on  the  Performance  Measurement  and  Analysis  of  Project 

ABACUS 


Commander 

US  Army  Trair.ir.fi  Support  Center 

ATTN:  ATTSC.-CT 

Ft.  Fust  is,  VA  23A04 


]  .  Reference  ltr,  ATTNG-TA-TS,  3.2  Jan  77,  subj:  Performance  Pec*  surer  nit. 
and  Analysis  for  Project  ABACUS  Computer  System. 

2.  Inclosed  is  the  report  on  the  Performance  Measurement  and  Anal:';  :'.'-,  cf 
Project  ABACUS.  USACSSEA  is  pleased  to  have  provided  assistance  to  the 
US  Army  Trainir.fi  Support  Center  and  will  continue  to  he  available  for 
assistance  to  your  command.  However,  since  this  Agency's  Pcrfcrmar.cc 
Measurement,  and  Analysis  resources  are  in  short  supply  and  in  great.  demand, 
it  is  requested  that  any  future  requirements  for  assistance  be  requested 
four  to  six  months  in  advance. 

POP.  TEE  C  Cl  BLANDER: 

f/ 

/  J!'  (___  it  - 

1  lncl  ^WILLIAM  R.  ANDREWS 

as  CPT,  ACC 

Adjutant 
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DEPARTMENT  OF  THE  ARMY 

HEADQUARTERS  UNITED  STATES  ARMY  SIGNAL  SCHOOL 
FORT  GORDON,  GEORGIA  SOSOS 


I*  REPLY  Rtf TO 

ATSU-DS-DS 


8  JUL  1977 


SUBJECT:  Project  ABACUS  Evaluation 


Director 

USA  Training  Support  .'enter 

ATTN:  ATTSC-CT 

Fort  Eustis,  Virginia  2?6oU 


1.  Reference  message  0120^Z  Jun  77,  Subject:  Project  ABACUS  Evaluation, 
which  requested  information  relative  to  evaluation  of  Project  ABACUS. 

2.  Anticipated  conversion  dates  are  as  follows: 

a.  Teletype  Equipment  Repair  (3 1J)  is  scheduled  to  begin  implementa¬ 
tion  with  a  new  program  of  instruction  on  11  July  1977  with  total  imple¬ 
mentation  by  1  November  1977. 

b.  Avionics  Communication  Equipment  Repair  Course  (35L)  began  imple¬ 
mentation  in  April  1977  with  total  implementation  scheduled  for  1  October 
1977. 

3.  The  approximate  number  of  students  that  will  complete  the  31J  and  35L 
Courses  prior  to  l6  December  1977  are: 

a.  Teletype  Repair  (31J)  -  117 

b.  Avionics  Equipment  Repair  (35L)  -  87 

1*.  Recommend  that  Annexes  E  and  K  (9^  hours)  from  the  Teletype  Repair 
Course  and  Annexes  F  and  K  (202  hours)  from  the  Avionics  Eauipment  Repair 
Course  be  considered  for  evaluation.  These  annexes  represent  lesson  mat¬ 
erial  which  is  closest  to  completion  of  student  validation  end  will  provide 
the  most  data  for  evaluation. 

FOR  fiiii  COMMANDANT: 


Captain,  Infantry 
P  ci  j  u  t  an  t 


»)NCLASSJFIFn 


ANNEX  F 


'I  r- 


O/J.O 


CDrjDSAry.GrTcn  w  ntwix^  va  //atthc-ct// 
ccor  usasicscu  ft  cor^oN  ga  //atcn-d/ac// 

INFO;  CDRUSATNGSrTCTR  FT  CORDON  CA  //AT7CC-C7-3D7/7 


srajr.r.rt  Project  ABACUS  Evaluation 

A.  Visit  2-4  May  77  LXC  Caravana,  ATSC  to  OSASIGS 

1.  During  ref  visit  it  vjas  discussed  that  the  final  evaluation  report 
on  Project  ABACUS  rhould  be  completed  by  April  1973.  Indications  ore 
that  this  is  a  realistic  target  date  and  planning  continues  to  neet 
that  date.  Accordingly  it  will  be  necessary  to  terminate  data  col- 

i 

lecticn  from  the  three  USASICS  courses  now  implemented  on  the  Project 
ABACUS  computer  syston  1ILT  16  December  1977. 

2.  Using  16  December  1977  as  the  data  collection  termination  date 
it  in  rogues ted  that  the  following  infortoatiou  be  provided  this 
office  ’.rLV  5  July  1777  so  as  to  facilitate  planning: 

c.  Aiiticipatcd  conversion  dates  for  the  Avionics  Communication 
Equipment  Repair  Course,  MDS  35E20  and  the  Teletype  Equipment 
Repair  Course,  MO 5  31J20. 


T/,C,  I'',  D'r,  CTD 
,  i  Jur.  77  Cl— - 
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ANNEX  E 


LIST  OF  MAJOR 
PROCUREMENTS 


1.  April  1973  -  Request  for  a  Proposal  was  issued  to  industry. 

2.  December  1973  -  GTE-Sylvania ,  Inc.,  was  awarded  the  contract. 

3.  April  1974  -  Initial  computer  system  was  delivered  to  the  Office 
of  the  Product  Manager. 

4.  July  1974  -  Initial  32-terminal  display  controller  was  delivered 
to  the  US  Army  Signal  School  (USASIGS). 

5.  May  1975  -  Full,  six  processor  multiminicomputer  system  was 
delivered  and  installed,  including  sixteen  terminals.  One  hundred 
and  twelve  terminals  were  placed  in  local  storage. 

6.  June  1975  -  Communications  study  was  completed. 

7.  July  1975  -  Communication  and  cabling  contract  negotiations 
were  conducted. 

8.  July  1975  -  FY76  maintenance  of  CTS  contract  negotiations  were 
conducted. 

9.  February  1976  -  Alphanumeric  system  terminal  was  purchased. 

10.  February  1976  -  Communications  installation  completed  and  full 
128-terminal  system  installed. 

11.  February  1976  -  Operating  system  RSX-11D,  version  6B,  was 
purchased . 

12.  June  1976  -  FY7T  and  FY77  maintenance  contract  negotiations 
were  conducted. 

13.  June  1976  -  Maintenance  spares  for  the  Project  ABACUS  System 
were  purchased. 
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Name 

Rank/ 

Grade 

Job  Title 

FOSTER,  ROBFRT  G. 

I.TC 

Prog  Dir 

KIMBERLIN,  DONALD  A. 

GS-1  3 

Chief, 

Test  Branch 

WTCKERT,  DAVID  A. 

2T.T 

i 

ADP  Off 

MUSSELWHTTE, HARRY  A. 

GS-1  2 

Ed  Spec 

ALTMAN,  BRYAN  D. 

GS-11 

Ed  Spec 

LAMB,  JANET  M. 

GS-11 

Ed  Spec 

BROWN,  DONALD  L, 

SFC 

Instr  Prog 

DIXON,  JOHN  W,  JR. 

SFC 

Instr  Prog 

HOOKER,  BERNARD  L. 

SFC 

Instr  Prog 

STOTTS,  JAMES  D. 

SSG 

Admin  NCO 

DUNCAN,  WILLIAM  L. 

SP5 

Programmer 

HUTSKO,  GARRETT  L. 

SP5 

Programmer 

MALCOLM,  VARA  G. 

SP5 

Programmer 

MASHEY,  JOEL  A. 

SP4 

Programmer 

ZARSKY,  DAVID  J. 

SP4 

Programmer 

JANTZEN,  RAILI  A. 

GS-4 

Clerk 

LANE,  JUDY 

GS-4 

Clerk 

Duty  Dates 


1  Jan  ib 


ZATIONAL  CHART 


ANNEX  B 


f  .' )  .Ay;  -op*  f  •  1 1 1  r;-  :j-  >:u;  i  >•  i '  i  I  \  for  t  he  im  r  i  i  •>  1  i  *;!><  d  at  Fort 

rd<n  ,i :  th.-  ■  ■  S  :'  i.i  .if  tii-  opcr.it  i  >P  1 1  test  ,in  i  iv.i !  m  •.  t  i  ■  ii  for  use 
in  ;icc.c.  t  J  in.  t  v  i  t  ••  1  i"  \1>( -C  rod'll  at  ions  in  offer*  .t  that  tine. 


:S)  Pr  i*!t-  fm  v. -Hi""  miintcmncr  N  gine  i  i .  * .  1  Oct  77, 


OTiiER 


a.  Fiiiu' i  nf>, : 


(1)  Cdr,  ATSC,  is  responsible  for  programming  and  funding  I'Y  7  7  as 
icrtnins  to  Pirdw.i  r «» /  sof  t  ware  acquisitions  and  associated  contract  change 
orders  and  system  riintm.inrc. 

(2)  The  Commandant ,  USASTCS,  will  provide  FY77  OMA  funds  for  nortral 
operating  supplies,  computer  consumables,  magnetic  tapes,  discs,  and  disc 
packs . 

(3)  The  Commandant,  USASICS,  will  fund  for  maintenance  of  the  system 
commencing  1  Oct  77  (FY78). 

b.  Responsibilities  for  items  not  specifically  covered  in  this 
Memorandum  of  Understanding  will  be  resolved  by  mutual  coordination. 

c.  This  Memorandum  of  Understanding  is  in  effect  until  the  conclusion 
of  the  operational  test  and  evaluation,  or  when  major  progran  changes  are 
made  by  higher  headquarters. 

d.  This  Memorandum  of  Understanding  is  effective  on  the  date  of 
signing  by  the  Cdr,  ATSC,  and  the  Commandant,  USASIC.S--* 


/SU  (rfcAv 


PAUL  r.  PEARSON,  RO 
Commander,  ATSC 


.  n  rV\fi  n  (<n7 


ulARI.ES  R.  MYF.R,  Jp' 
Commandant,  USAS^GS 

V 


the  operational  test  and  evaluation  will  be  coordinated  with  the 
Commandant,  USAS1GS.  The  final  document  shall  include  Commandant, 
USAS1GS,  concurrence/comments . 

(2)  Prepare  appropriate  program  and  planning  documents  as  required 
by  and  for  submission  to  higher  headquarters. 

(3)  Collect  data  from  the  three  courses  participating  in  the  opera¬ 
tional  test  and  evaluation  of  Project  ABACUS. 

(4)  Advise  the  Commandant,  USASIGS,  of  the  progress  and  status  of 
the  operational  test  and  evaluation,  as  required. 

(5)  Provide  the  computer  systems  engineer  and  software  maintenance 
until  the  system  is  accepted  by  USASIGS. 

(6)  Provide  system  hardware  maintenance  through  30  Sep  77. 

(7)  Maintain  a  field  office  at  the  USASIGS,  Fort  Gordon,  Georgia, 
until  the  operational  test  and  evaluation  of  Project  ABACUS  is  completed. 
This  office  is  designated  within  the  ATSC  as  the  Test  Branch,  Systems 
Design  Division,  Communicative  Technology  Directorate  (CTD) ,  Fort  Gordon, 
Georgia’. 

b.  The  Commandant,  USASIGS,  will 

(1)  Provide  appropriate  facilities  for  Project  ABACUS  in  accordance 
with  requirements  established  by  the  Cdr,  ATSC. 

(2)  Operate  the  system  hardware/sof tware  during  the  operational 
test  and  evaluation  phase. 

(3)  Plan,  program  and  budget  additional  system  capacity  not  required 
by  the  operational  test  and  evaluation.  Any  additional  use  of  the  system 
in  this  manner  will  be  jointly  concurred  in. 

(4)  Provide  the  supervision  and  staff  required  to  maintain  the 
developed  course  material. 

(5)  Prepare,  conduct  and  administer  the  Frogram  of  Instruction  (POI) 
for  the  operational  test  and  evaluation. 

(6)  Provide  working  space  for  personnel  assigned  to  the  Test  Branch, 
ATSC,  Fort  Gordon,  Georgia,  and  coordinate  normal  administrative  support 
for  personnel,  to  include  records,  finance  and  accounting,  training  and 
personnel  actions. 


ANNEX  A 


MEMORANDUM  OF  UNDERSTANDING 

i 

BETWEEN 

Commander 

US  Army  Training  Support  Center 
Fort  Eustis,  Virginia 

1.  INTRODUCTION 

a.  References: 

(1)  USASICS  Reg  10-2,  Organization,  Mission  and  Functions,  July  1973. 

(2)  Prototype  Computerized  Training  System  Management  Plan  (as 
revised  13  Nov  73). 

(3)  Product  Manager  Charter,  Prototype  Computerized  Training  System 
(as  revised  5  Nov  73). 

(4)  Letter,  ATSN-CTS,  USASCS,  29  Nov  73,  Designation  of  Courses 

for  Prototype  Computerized  Training  System  (CTS) ,  with  1st  Ind,  ATTS-ITF, 
TRAD'JC,  ,11  Dec  73. 

b.  In  accordance  with  cited  references,  this  Memorandum  of  Under¬ 
standing  (MOD)  delineates  responsibilities,  command  and  control  channels, 
and  procedures  to  be  followed  in  the  operational  test  and  evaluation,  to 
include  final  report,  of  a  Prototype  Computerized  Training  System  (Project 
AEACUS)  by  the  US  Army  Training  Support  Center  (ATSC) ,  Fort  F.ustis, 
Virginia,  and  the  US  Army  Signal  School  (USASIGS),  Fort  Gordon,  Georgia. 

2.  GENERAL  RESPONSIBILITIES 

a.  The  Commandant,  USASIGS,  reference  la(l),  is  responsible  for 
preparing,  conducting,  administering,  and  maintaining  the  three  courses, 
reference  la  (4),  during  the  operational  test  and  evaluation  phase  of 
Project  ABACUS. 

b.  Cdr,  ATSC,  is  responsible  for  the  design,  hardware/software 
development  and  maintenance,  system  control  and  data  collection  during 
the  operational  test  and  evaluation  phase  of  Project  ABA.CUS. 

3.  DETAILED  RESPONSIBILITIES 
a.  The  Cdr,  ATSC,  will 

(1)  Conduct  the  operational  test  and  evaluation  of  Project  ABACUS 
and  prepare  the  required  evaluation  reports.  Documents  applicable  to 


Commandant 

US  Army  Signal  School 
Fort  Gordon,  Georgia 


3.  on  current  imolementati  an  schedules  and  t’r'n 

established  cutoff  date  (16  December  1977)  for  data  col ] «ctio- ,  '•nlv 
the  31E20  course  will  be  evaluated  in  its  entirety.  Selected  annexes 
from  the  31J20  and  35L20  will  be  evaluated. 


VIII.  RELATED  PROJECTS 

A.  Computer  Managed  Instruction  Project  (CMI).  A  Concept 
Evaluation  Program  (CEP)  study  has  been  approved  to  evaluate  the  use 
of  optical  scanners  as  an  input  media  to  computers  to  manage  the 
conduct  of  training  for  self-paced  courses.  The  test  proponent  for 
this  CEP  is  ATSC  and  USASIGS  is  the  test  organization. 


B.  Computer  Application  to  Training  and  Simulation  (COMTRAINS) . 
A  command  study  has  been  prepared  to  evaluate  the  Project  ABACUS 
computer  system.  The  objective  of  this  study  is  to  assess  the  hard¬ 
ware  and  software  resotirces,  the  system  configuration,  and  recommend 
an  optimum  use  of  the  available  resources  for  CMI  applications  in 
resident  and  nonresident  training  programs.  The  pronosals  by  the 
resoondents  to  a  Request  for  Proposal  (RFP)  are  being  evaluated. 


IX.  CONCLUSION 


This  has  been  the  year  that  saw  the  culmination  of  a  5  year  effort 
to  fiold  a  prototype  computerized  training  system  using  the  multi¬ 
minicomputer  concept.  The  acceptance  of  the  system  for  the  Government 
put  the  project  into  its  last  phase,  evaluation.  As  the  USASIGS  nuts 
each  course  on  the  system,  data  is  being  collected  and  collated  for 
the  final  report.  The  time  lapse  since  the  acceptance  of  the  system 
and  USASIGS  implementation  of  the  courses  will  permit  the  evaluation 
of  the  entire  31Ef 3  course,  but  only  selected  annexes  of  the  31J20 
and  35L20  courses.  Regardless,  there  is  a  high  degree  of  confidence 
that  enough  data  will  be  available  to  make  a  valid  evaluation  of  the 
comouterized  training  system.  The  system  evaluation  by  the  CSSEA 
verified  that  there  is  ample  capacity  in  the  svstem  for  further  training 
applications.  This  computer  resource  provides  the  USASIGS  the  onnortunit 
not  only  to  further  automate  training  but  to  conduct  projects  to 
explore  new  training  uses  of  the  system  and  thereby  become  the  Army's 
center  of  excellence  for  automated  training  systems. 
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Management  Summary 


1.  This  report  documents'  the  Performance  Measurement  and  Analysis  (PMA) 
of  the  Project  ABACI'S  Computerized  Training  System  located  at  Ft.  Cordon, 
Georgia . 

2.  The  purpose  of  rhe  FMA  vas  to  provide  Project  A3ACTT  p<»rs. -rei  with 
information  on  system  resource  utilization. 

3.  The  Project  ABACUS  Computerized  Training  System  is  comprised  of  six. 
Digital  Ec'uiprcnt  Corporaticr.  PDP  11/35  minicomputers.  She  system  is 
expected  to  support  four  hundred  students. 


4.  The  on-site  measurement  ard  analysis  phase  was  performed  1-12  March  1977 . 
The  PMA  revealed  that: 

a.  The  high  speed  1/0  charnels  have  94.42%  unused  t'lpcc’t;  ,  .  ri  the 
lev  soeed  I/O  channels  have  80.12%  unused  capacity. 

b.  The  Data  Base  Controller  CPU  has  approximate!  y  90%  uru.-L.-e  capacity. 

c.  The  system,  as  designed  and  configured,  is  undcmtllii.— - . 

d.  Cnlv  one  of  the  four  DIVA  disk  drives  on  the  Data  F-.r.e  Controller 
is  reouired  to  hold  all  of  the  lesson  material  for  <-hre*  courses  to  be 

f retailed  or.  the  system. 

Transfer  of  three,  of  the  DIVA  .disk  drives  from  th'  Par  •>  Base  Cor.trc.lle 
to  the  System  Controller  would  improve  instructor  pregromer  productivity 
by  an  estimated  30%  . 

f.  The  increased  instructor  prograraer  productivity  would  he  wasted 
•r.h'sc  additional  courses  are  installed  on  the  system  or  extensive  revisions 

.sent  course  material  are  planned. 

, .  The  transfer  of  the  three  DIVA  disk  drives  to  the  System  Controller 
•.—  -IP  -ecuire  the  purchase  of  a  DIVA  DC-234  disk  controller. 

«  *.tiroV>?.e  f  a  DIVA  disk  controller  and  tt  an **.'«:*.  *•  three 

ill  •  ‘  '  ’  )r  "as  to  the  Data  Base  Controller  would  v  ■■  U  ..  ;;  *"  ’  c  1 1  ’i 

Equipment  Corporation  (DEC)  disk  controller  and  3  dis*.  dri\-“o  .  ...s 

surplus.  If  an  Army  instaila.tion  required  and  could  reutilice  this  equip¬ 
ment,  then  the  total  transaction  would  actually  result  in  a  saving  to  the 
Army  of  218,600. 


5.  It  is  recomended  that: 


a.  The  systeri.,  as  designed  and  configured,  should  net  be  p 

b.  The  purchase  of  the  DIVA,  disk  controller  be  approved  on 
is  a  der.onatroted  need  and  an  A  ray  installation  guaranteed  to  r 
the  surpiused  TF.C  ecuiprr.ent,  Otherwise  the  three  DIVA  disk  cri 
be  declared  surplus. 


I.  wtrtt  rrr.t  of  the  Problem.  The  l'S  Army  Training  Support  Center, 

Ft.  Eustis,  V'rtinia,  requested  the  Performance  Analysis  Eranch  of  the 
t"'  *r-y  Cc-"--t<--r  Eysters  Support  cr.d  Evalunt i cn  Agency  (UCACSSEA)  to  under- 
toVe  a  rerf-rr -'r.ce  Measurement  and  Analysis  (PMA)  of  the  Project  ABACUS 
( Army  Bared  .‘utewated  CUrrieulim  System)  Computerized  Training  System  (CIS) 
located  at  Ft.  Cordon,  Georgia.  The  purpose  of  the  DMA  vas  to  provide 
P^jr-ct  /".‘.CUE  personnel  with  information  on  system  resource  utilization. 

II  •  Facts  Bearing  on  the  Problem. 

1.  System,  description.  The  ABACI’S  CTS  is  trace  up  of  six  Digital  Equip¬ 
ment  Corporation  (EEC)  PDP  11/25  minicomputers  and  peripheral  equipment 
manufactured  by  DEC,  Diva,  Ire.,  and  GTE-Sylvnnia .  The  six  PDP  11/35  mini¬ 
computers  are  used  as  follows:  one  as  the  System  Controller,  one  as  the 

Data  Base  Controller,  and  four  as  Display  Controllers.  Each  Display  Controller 
supports  thirty-two  display  terminals.  There  are  one  hundred  twenty-eight 
display  terminals  on  the  system.  The  Data  Ease  Controller  is  connected 
to  each  Display  Controller  and  to  the  System  Controller  using  Direct  Memory 
Access  (DMA)  links.  The  value  of  the  direct  memory  access  link  is  that 
data  nay  be  transmitted  between  main  memories  without  interrupting  the 
CPU  controlling  the  receiving  main  memory.  The  System  Controller  is  con¬ 
nected  to  each  Display  Controller  via  programed  I/O  links.  The  programed 
I/O  link  is,  generally  used  when  small  volume  data  transfers  are  to  be 
tiioiU  t!  y  uticrtuSt:  Lue  v*FL  *  S  clixl.f,  LOwli  CiiC  SCtuuiri^  ciuC  IcCcIV  a-T.  £  LIS.  it* 

memories  must  execute  instruction  code  tc  start  and  complete  the  data  trans¬ 
fer.  A  more  detailed  system  configuration  is  provided  in  Appendix  A  of 
this  report. 

2.  Control  software.  The  System  Controller  uses  the  DEC's  RSX-11D 
operating  system.  The  Display  Controllers  and  the  Data  Ease  Controller 
do  not  use  separate  control  software.  Any  functions  normally  handled  by 
control  software  are  coded  as  part  of  the  programs  resident  in  the  Display 
Controllers  and  Data  Ease  Controller. 

a 

3.  Background. 


a.  The  ABACUS  computer  system  is  a  unique,  one  of  a  kind  system. 

It  will  r.ct  be  proliferated  in  its  present  form;  however,  the  knowledge 
gained  from  the  use  of  this  system  is  expected  to  be  useful  in  the  develop¬ 
ment  of  future  systems. 

b.  The  system  *;as  originally  designed  fer  Computer  Aided  Instruction 
(CAI ) ,  which  is  somewhat  similar  in  function  to  a  programmed  learning  text. 
The  expected  utilisation  of  the  system  for  CAI  dictated  a  one  second  response 
tire  r.t  the  display  terminals. 


c.  The  CTS  is  now  used  for  Computer  Managed  Instruction  (CMI) ,  rather 
than  Computer  Aided  Instruction.  CMI  does  not  require  the  shcrt  response 
times  required  by  CAI  and  differs  from  Computer  Assisted  Instruction  in 
that  more  supplemental  material  (e.g.,  printed  manuals)  is  used  by  the 
student  at  the  Gil  terminal. 

d.  The  system  is  capable  of  handling,  on  line,  one  hundred  twenty 
students  and  eight  instructors,  concurrently. 

4.  Workload  Description. 

a.  Courses  to  be  supported.  Three  communications  equipment  repair 
coursesare  to  be  installed  on  the  CTS.  They  are  Radio  P^epair  (course  31E), 
Teletype  Pepair  (course  31J)  ,  and  Avionics  Repair  (course  35L) .  The  Radio 
Repair  course  has  beer,  fully  installed  on  the  system;  half  of  each  of  the 
other  two  courses  has  been  installed  on  the  system. 

b.  Present  workload.  Students  began  using  the  system  in  early  Jan¬ 
uary  1977,  beginning  a  one  year  evaluation  of  the  system.  During  the 
measurement  phase  of  the  PMA,  approximately  seventy-five  students  were 
using  the  system.  Eventually,  an  expected  average  daily  load  of  four 
hundred  students  ’trill  use  the  system  for  training.  The  rate  of  increase 

of  student  'utilization  of  the  CTS  will  depend  on  how  quickly  the  instructor 
programmers  are  able  to  develop  instructional  material  and  compile  ir  on 
the  system,  because  the  actual  workload  placed  on  the  system  by  the  low 
number  of  students  did  not  exercise  the  system  sufficiently,  a  workload 
simulator  was  used  tc  provide  more  system  activity. 

c.  Simulated  workload.  The  simulator  used  on  the  CTS  was  an  actual 
lesson  modified  to  replace  the  student  with  an  automatic  response  based 
on  a  tire  limit  determined  from  a  random  number.  The  simulator  was  run 
at  tT-*o  processing  rates.  The  Slow  Simulator  response  is  timed  t*'  ocrv.r 
from  twenty  to  forty-five  seconds  after  the  screen  is  displayed.  The 
Fact  Simulator  response  is  timed  to  occur  from  ten  to  twenty  seconds  after 
the  screen  is  displayed. 

5.  Time  period  of  PMA.  The  PMA  was  conducted  during  the  time  period 
of  4  January 'through  25  March  1977  .  The  time  at  the  ABACUS  site  vas 
divided  into  three  phases: 

a.  First  preliminary  visit  -  4  through  7  January  1977.  Second  pre¬ 
liminary  visit  -  25  through  27  January  1977. 


or 


b.  The  preliminary  visits  were  used  to  determine  problems  to  be 
studies  to  be  made  during  the  Measurement  Phase  of  the  project. 


addressed 


c.  Measurement  Phase  -  1  through  25  March  1977  .  The  measurement  of 
system  perfcrt.ar.ce  and  analysis  of  the  data  collected  occurred  curing  this 
phase  of  the  project. 


6.  Resources  supplied  bv  VSACSSEA. 

a.  COMTEN,  Inc.,  D-870C  hardware  roniter.  TV. is  hardware-  ircnitcr  in¬ 
cludes  two  types  of  data  collection  devices,  described  below.,  arc  stores 
the  data  collected  cn  ragn.etic  tape: 

(1)  The  D-7916  hardware  monitor  which  counts  or  tires  ewentr  using 
high  speed  electronic  counters,  the  contents  of  which  ore-  v-'. ■-i-.cn  "^r:od- 
ically  t-~  magn  c  tape. 


(2)  The  D-80A8-T.I  data  controller  which  collects  information  into 
three  sixteen-bit  icgisters  and  stores  this  information  in  buffers,  the 
contents  of  which  are  w.-ritten  periodically  to  magnetic  tape. 

b. 

formats 
reports 

7.  Measurements  to  be  performed.  A  copy  of  the  Kerorandur:  cf  Agree¬ 
ment  between  rs.ACSCFA  and  the  Training  Support  Center  is  in  Append!::  B. 
The  planned  measurements  were: 


COMTEK,  Inc.,  DYNAPAJl  6.3  data  reduction  software.  Thin  tofrware 
the-  hardware  monitor  data  stored  cn  magnetic  tape  irtc.  printed 
for  analysis. 


a.  General  I/O  activity  for  the  system  to  include  the  •  el  1  cv-: re  : 

(1)  All  Direct.  Merory  Access  links  ,  which  connect  the  la  p.cse  for  trolls 
to  the  Pvstec  Controller  and  each  Display  Controller. 

(2)  A.1I  nrorr armed  I/O  links,  which  connect  each  Display  Controller 
to  the  System  Controller. 

(3)  Data  Ease  Controller  disk  activity,  including  seek  it?  :r rer-ss 
and  unit  busy  t  <->> . 


,  including  r^ok  ..n  progress  and 


c’ler  disk  activity 


b.  Main  merer"  prcpr.r-  (instruction  address)  mapping  of  the  follovine 

(1)  System  Controller 

(2)  Data  Ease  Controller 

(3)  Display  Controller 

c.  Determination  of  CPU  idle  time  on  the  following  CPU's: 

(1)  System  Controller 

(2)  Data  Ease  Controller 

(3)  Disnlay  Controller 

8.  Scratch  area  contention  measurement .  This  measurement  involved 
counting  the  number  of  tines  the  Display  Controller  software  vas  unable 
to  process  display  data  because  no  scratch  (work)  area  in  memory  was 
available  fer  use. 

III.  Discussion. 

* 

i.  Problems  encountered. 

a.  Probe  point  development.  The  PMA  team  did  not  have  satisfactory 
probe  points  for  the  project  until  24  February  1977,  because  local  site 
Customer  Engineer  personnel  did  not  have  the  necessary  expertise  to  pro¬ 
vide  the  PMA  team  the  probe  points.  This  delayed  the  beginning  of  the 
measurement  phase  cf  the  project  until  1  March  1977;  thus,  the  on-sitc 
measurement  peried  vas -one  week  less  than  planned. 

b.  Data  reduct ‘on  support.  Data  reduction  support  was  generously 
made  available  by  me  Savannah  River  Plant,  Energy  Research  and  Develop¬ 
ment  Admin1’  stratior. .  However,  the  Savannah  River  Plant  1600  bpi  tone 
drives  could  not  r end  hardware  monitor  system's  1600  bpi  magnetic  tapes. 
This  problem,  vas  re~ol"ed  by  copying  the  1600  bpi  tapes  to  800  hni  at 
the  Ft.  Cordon  Manor  :r.rnt  Information  Systems  Office,  before  reducing 
them  at  the  Savannah  Diver  Plant  .  The  Savannah  River  Plant  computer  .sys¬ 
tem  had  no  trouble  read  in"  the  copied  SCO  bpi  tapes.  However,  the  PMA 
team,  vas  net  assured  the’,  could  reduce  their  rev  data  until  the  third 
week  of  the  rn-site  measurement ,  16  March  1977. 


c.  Strobe  for  instruction  address  data.  Attempts  to  synchronize  a 
nine-bit  signal  pattern  with  the  Unibus  register,  on  the  DEC  PDF  11/35, 
containing  an  instruction  address  proved  unsuccessful.  However,  useful 
Instruct Icn/data  fetch  address  cap  data  was  collected  using  a  simple  single 
line  strobe,  beginning  22  March  1977. 

2.  Studies  net  completed. 

a.  Mo  instruction  address  cap  of  the  Data  Ease  Controller  was  made, 
due  to  a  lack  of  available  time. 

b.  It  was  intended  to  use  the  D-772C  Bit  Comparator  to  directly  measure 
idle  time  cn  the  System  Controller,  and  to  collect  idle  loop  timing  infor¬ 
mation  on  the  Data  Base  Controller  end  Display  Controllers  using  the  D-8028 
Data  Handler/Comparator.  The  FMA  team  was  unable  to  collect  the  above  data 
due  to  problems  in  using  the  nine-bit  strobe  discussed  in  paragraph  III.l.c 
above,  and  a  lack  of  available  time. 

c.  Because  the  memory  nap  data  was  collected  late  in  the  project,  the 
PKA  team  was  not  able  to  make  a  conclusive  analysis  cf  the  data.  Further, 
ABACUS  personnel  did  net  have  source  listings  for  the  F.SX-llD  operating 
system  used  on  the  System  Controller.  Copies  of  the  memory  naps  were  given 

to  Project  ABACUS  personnel  for  their  own  analysis. 

* 

d.  Scratch  area  contention  measurement .  The  PKA  team  was  unable  to 
make  a  conclusive  anlaysis  of  the  data  from  this  measurement  because  the 
data  collected  running  the  Fast  Simulator  did  not  represent  a  typical 
workload . 

3.  Findings. 

a.  Untapped  system  resources.  The  CTS  contains  much  more  power  than 
is  necessary  for  its  present  use  in  CHI.  The  one  second  terminal  response 
time  is  no  longer  needed  to  assure  that  the  student  w-ill  maintain  attention 
and  move  quickly  through  the  instructional  material.  Data  collected  in¬ 
dicates  that  there  is  considerable  untapped  power  in  the  system. 

(1)  I/O  activity.  The  availability  of  untapped  system  resources  is 
demonstrated  by  the  low  activity  on  the  Direct  Memory  .Access  links  (between 
the  Data  Base  Controller  (DEC)  and  the  System  Controller  (SC)  and  Display 
Controller  (DC))S  and  Programed  I/O  links  (between  the  SC  and  the  DC),  as 
summarized  in  tables  4-1  and  4-2,  below. 


Table  4-1 

Direct  Memory  Access  Link  Activity 
(Expressed  as  a  percent  of  measurement  tine) 


East  Simulator 
Slow  Simulator 
Normal  Daytime 


Between 

DEC/DC1 

19.082 

2.33 

.23 


Between 

DEC/DC2 

20.55% 

2.06 

.56 


Between  Eetvecn 
DBC/DC3  D3C/DC4 


21.01% 

1.97 

.30 


22.65% 

2.58 

.37 


DMA 

Average 

20.83% 

2.23 

.36 


It  is  estimated  that  the  Direct  Memory  Access  links  can  support  40%  activity. 
It  follows  that  the  amount  of  untapped  I/O  resources  in  the  Direct  Memory 
Access  links  is  the  difference  between  40%  and  2.23%, the  Slow  Simulator 
average,  which  is  37.77%.  The  Slow  Simulator  cost  nearly  approximates  the 
full  four  hundred  student  workload  to  be  placed  on  the  system.  The  Direct 
Memory  A.ccess  links  have  94.42%  unused  capacity  (37.77  Z  40%  x  100  «  94.42%) 

Table  4-2 

Programed  1/0  Link  Activity 

_ (Expressed  as  a  count  of  words  transferred  per  minute)* 


Fast  Simulator 
Slow  Simulator 
Normal  Daytime 


Between 

SC/DC1 

3036.1 

593.5 

72.0 


Between 

SC/DC2 

3051.7 

598.4 

130.1 


Ee tween 
SC/DC4 

2960.1 

607.7 
54.4 


.Average 

3015.9 

599.8 

85.5 


♦Programed  I/O  link  activity  between  the  System  Controller  and  Display 
Controller  3  is  not  presented  because  the  data  collected  was  not  complete. 


The  Fast  Simulator  average  is  close  to  the  maximum  average  vrord  per  minute 
transfer  rate  for  the  Programed  I/O  links  because  the  burst  rate  or.  these 
links  probably  approaches  the  5100  word  per  minute  maximum.  The  Slow 
Simulator  average  is  19.88%  (599.8  *  3015.9  x  100  *  19.88%)  of  the  Fast 
Simulator  average,  indicating  that  the  CTS  Programed  I/O  links  have  80.12% 
unused  capacity  (100%  -  19.88%  *  80.12%). 

(2)  CPU  Activity  on  the  Data  Base  Controller.  No  instruction/data 
fetch  activity  map  data  was  collected  during  the  project.  However,  because 
I/O  activity  to  and  from  the  DBC  was  extremely  lev;,  it  is  apparent  that 
CPU  activity  vas  very  low  also.  This  is  because  the  cr.ly  function  c>f  the 
DBC  is  to  access  the  CTS  data  base.  Further,  data  is  sent  or  received 
through  a  Direct  Memory  Access  link  which  requires  very  little  CFU  activity 


to  handle:  data  transfers.  Daytime  Direct  !!emory  Access  activity  to  and 
from  the  DEC  was  less  than  one  percent  of  total  measurement  tire.  It 
seems  from  this  infermtion  that  CPU  idle  tine  in  the  DBC  is  presently  above 
ninety  percent  and  would  still  be  high  when  a  full,  four  hundred  student 
load  is  placed  on  the  CTS. 

b.  Transfer  of  DIVA  disk  units  to  the  System  Controller. 

(1)  Unused  DIVA  disk  drives.  The  Data  Base  Controller  requires  only 
one  of  the  tour  available  disk  units  to  contain  all  present,  student  material. 
Further,  this  one  unit  will  still  be  sufficient  to  contain  all  student 
material  when  the  full,  lour  hundred  student  workload  is  placed  cn  the  sys¬ 
tem.  Specifically,  200  of  the  400  available  cylinders  on  one  DIVA  disk 
pack  have  been  filled  with  two-thirds  pf  the  intended  course  material  cn 

the  system.  To  date,  the  full  31E  (Radio  Repair)  course,  half  of  the 
31J  (Teletype  Repair)  course,  and  half  of  the  35L  (Avionics  Repair)  course 
have  been  put  on  the  system.  With  only  half  the  material  for  two  courses 
remaining,  the  pack  will  be  capable  of  holding  all  necessary  course  mat¬ 
erial  . 

(2)  Improvement  in  instructor  programer  product  ivity . 

(a)  The  instructor  pregramers  create  the  student  lesser,  material  cn 
the  System  Controller  in  two  steps.  First  the  source  code  is  entered  and 
stored  on  the  System  Controller  PK05  disk.  The  instructor  pregramer  as¬ 
sembles  and  then  evaluates  the  student  lesson  material.  If  necessary, 
corrections  are  applied  to  the  lesson  material  until  the  lesson  material 

is  the  way  the  instructor  programer  wants  it*  irher.  error  free,  the  assembled 
student  material  is  stored  temporarily  on  disk  and  later  dumped  to  tape. 

Then,  the  tape  is  loaded  on  the  Data  Base  Controller’s  DIVA  disk  device  £5. 

(b)  Project  ABACUS  personnel  estimate  that  instructor  programer  pro¬ 
ductivity  could  be  increased  an  estimated  fifty  percent  if  all  three 
courses  could  be  kept  on  line  during  development.  Presently,  only  cne 
course  can  be  kept  on  line  at  one  time,  resulting  in  instructor  pregramers 
being  unable  to  work  with  their  lesson  material.  Ecvever,  the  increased 
instructor  programer  productivity  would  be  wasted  unless: 

• 

1  More  than  the  present  three  courses  are  to  be  installed  on  the 
system,  or; 

2^  Extensive  and  continuous  revisions  of  present  course  material 
are  planned. 


r  •»*.*  •«' 


(3)  The  proposed  transfer. 


I 


i 


i 


Value  of  DEC  equipment  made  surplus: 


KK11D  controller 

$  9,900 

•• 

3  RK05  disk  drives 

15,300 

1  . 

,  Total 

$25 ,200 

. 

Cost  of  DI\ A  DC— 234  controller 

6,600 

Possible  savings 

$18,600 

•  ■  •  *■ 

(a)  Project  ABACUS  personnel  want  tc  eliminate  this  disk  to  tape  pro¬ 
cessing  and  have  more  disk  space  for  instructor  prograrer  lesson  data  on 
the  System  Controller  by  replacing  the  three  smaller  DEC  PK05  (1.2  million 
word  capacity  each)  disk  drives  with  the  three  unused  DIVA  (29  million  word 
capacity  each)  disk  drives  free  the  DBC.  This  would  necessitate  the  pur¬ 
chase  cf  an  additional  DIVA  disk  controller,  although  It  would  allow  three 
RK05  disk  drives  and  their  RK11D  controller  to  be  declared  surplus. 

(b)  The  data  in  table  4-3,  below,  shows  that  the  transfer  of  the  DIVA 
disk  drives  and  purchase  of  the  DIVA  disk  controller  could  be  made  at  a  . 
$18,600  savings  to  the  Army  if,  and  only  if,  there  is  a  demonstrated  need 
for  the  transfer  and  another  Army  installation  had  guaranteed  to  reutillze 
the  DEC  RX11D  disk  controller  and  RK05  disk  drives  declared  surplus. 

Table  4-3 

_ Savings  possible  in  transferring  DIVA  disk  drives  _ 


5.  Transfer  of  three  of  the  DIVA  disk  drives  frcn  the  DEC  to  the 
System  Controller  would  improve.  instructor  prograrer  productivity,  by  an 
estiitated  fifty  percent.  . 

6.  The  incensed  instructor  prograr.er  productivity  would  be  wasted 
unless  additional  courses  are  installed  cn  the  system  or  extensive  revisions 
of  present  course  naterial  are  planned. 

7.  Transfer  of  the  three  DIVA  disk  drives  to  the  System  Controller 
would  require  the  purchase  of  a  DIVA  DC-234  disk  controller. 


8.  The  purchase  of  a  DIVA  disk  controller  and  transfer  of  the  three 
DIVA  disk  drives  to  the  DEC  would  result  in  a  DEC  disk  controller  and  three 
disk  drives  becoming  surplus.  If  an  Army  installation  required  and  could  . 
reutllize  this  equipment,  then  the  total  transaction  would  actually  result 
in  a  savings  to  the  Army  of  $18,600. 

V.  Recommendations . 

1.  That  the  system, as  designed  and  configured,  should  not  be .pro¬ 
liferated. 

2.  That  the  purchase  of  the  DIVA  disk  controller  be  approved  only  if 
there  is  &  ueuuusiiaUu  need  and  an  Army  installation  guaranteed  to  i'e- 
utilizc  the  surplused  DEC  equipment.  Otherwise  the  three  DIVA  disk  drives 
should  be  declared  surplus. 


APPENDIX  A 


VQ  Xi 


Description  o t  the  Computer  System 


Ciiil;;.  ..  contains  u>.  cnart-  oi  the  hardware  conf irurt.^u  cf  t».c 

ital  Equipment  Corporation  PDP  11/35  computer  system  used  by  Project 
AC US  in  the  Computerized  Training  System  (CTS).  Figure  1  den  lets  the 
S  Functional  Block  Diagram.  Figure  2  depicts  the  Inter-Computer  Dat- 


» 


t 
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computer 


Memorandum  cf  Agreement 


•  -  —  •  V?VODAf,C:j"*  Or  C*T?.T  '  -  - -  '  —  —  ■ 

BETWEEN 

Prod'!-*  -a go-  '  '  ;  "  '  **  l)S  Amy  Computer  Svstcms  'urrsrt 

Computer  iced  7-air.  i  r,c  :./s--:-m  and  Ev2 ! us* 5 on  Age-cv 

US  Army  7ra:nlng  Support  Center  System  Tec^r.  i  qucs  and  Ar-aiy,  :s  C  I  -ec 

Fort  Eur-tis,  VA  Washington  CC 

1.  Purpose.  7Ke  purpose  cf  this  Memorandum  of  Aqreerert  f"GA)  is  to: 

a.  Define  the  specific  m  e  a  s  u  r  err-  e  o  t  ob  lect  1  vps  cf  the  Pc-rf  crsan-o 
Measurement  an  1  Analysis  (PMA)  cf  the  Project  ABACUS  Digital  Ecu i pr.enr  Corp¬ 
oration  PSP-’ 1/35  computer  system  located  at  Fort  Gordon,  GA. 

b.  Identify  the  manpower  and  PMA  tools  which  will  be  brought  to  bear 
upon  tbe  p-ob ! e-m 

2.  Scene.  This  VGA  covers  all  activities  relating  to  the  P'-A  beginning 

5  January  tbrouch  25  '-’arch  1977.  The  specific  schedule  is  for  ?  two  phase 
effor-f  as  follows: 

a.  First  preliminary  (on-site)  analysis:  5  through  8  January  1977. 

b.  S *3 core!  prs!  i p ! r 3 ry  fon-sits)  ^  r.  p,  t  y  s  f  s  *  75  ’thrcooh  2P  *977. 

c.  Cc~ p u f e r  measurement  and  analysis:  22  February  through  25  March  1977. 

3.  Gen^-al  !ec*  ive.  The  general  purpose  of  the  PMA  is  to  collect  dara  that 
will  pr-vir’e  *7  -- ccuct  Manage-  a  sound  basis  for  'nakinc  recce— endatior.s  +9 
TPAD2C  2-c  Cera ent  cf  Army  concerning  the  prototype  technical  system,  po¬ 
tential  of  individual  components  and  those  areas  requiring  further  research 
and  development. 

A.  S-‘~c  i  f  ■  c  h.y  ■-  --*  i  v--  s .  The  PM  A  will  address  the  following  specific  objective 
each  cf  which  '■ill  re  aonroacned  and  completed  in  turn,  time  oerrr.ltt  Ing.  Each 
objeo4  !  v  w*  i  I  he  re  r  ~  :  f  i  shed  in  the  order  that  t  hey  are  listed  below.  Mo 
succeed  i  r  r  c.b c4- We  *  ‘  l  ?  be  initiated  until  the  preceding  objective  ^as  be»n 
sa  f  i  s  *  cc  tor  i  1  v  c^ed.  However,  failure  to  complete  an  objective  will  -r1 

result  In  extending  the  measurement  period. 

a.  Objective  1.  General  I/O  activity  for  the  system,  to  include  the 
fo  t lowing: 

(1)  At  I  CAUG’s  f  OVA  Channel  si 

(2)  All  CPI  1C’ s  (Programmed  I/O  links) 

(3)  DIVA  Disk  Activity 


(4)  DEC  R\C5  D  W  Activity  at  System  Controller 


b.  Objective  2.  Memory  (Instruction  address)  mapping  of  the  system 
In  the  following  priority: 

(1)  System  Controller. 

(2)  Data  Case  Controller. 

(3)  Disolay  Controllers. 

c.  Objec+ive  3.  Determination  of  CPU  idle  time  in  the  following  pricri+y 

(1)  System  Controller. 

(2)  Data  Base  Controller. 

(3)  Display  Controller. 

5.  Approach.  The  approach  to  analysis  of  data  collection  will  be  as  follows: 

a.  Identify  probable  collection  criteria. 

b.  Design  measurement  plan  for  collection  of  data  necessary  tc  validate 
Identified  criteria. 

c.  Make  measurement(s) . 

d.  Determine  if  measurement  result  prove  cause's)  valid  (if  net,  return 

to  step  ^a). 


6.  Resources  to  be  Acolied  to  the  Project, 
a.  To  be  supplied  by  CSSEA: 

(1)  Manpower. 

(a)  The  assigned  CSSEA  PMA  Project  leader  Is  Mr.  Gerald  B.  Dargusch, 
Computer  Specialist,  Performance  Analysis  Branch,  CSSE-ST-P,  telephone 
AUTOVON  227-4160/4175. 

(b)  Level  of  support:  Two  performance  analysts  during  the  computer 
measurement  .and  analysis  phase  of  the  project. 

(2)  PMA  tools  available: 

(a)  Comten,  Inc.  D-8700  Hardware  Monitor  System. 

(b)  Ccmten,  Inc.  CVNAPAR  Hardware  "onl'cr  Data  P.-duc  ■  i  on  . 


b.  To  be  supplied  by  Project  ABACUS! 


(1)  Manpower:  Project  ABACUS  will 
PMA  team  member,  an  Individual  who  is  there 
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work  as  n  member  of  the  ffW  team  in  developing  and  carrying  cut  measurement 
plane  and  will  bo  available  fulltime  for  the  life  of  the  project.  Addition¬ 
ally,  Project  APACU3  will  make  available  oth^r  knowtedgable  pe^sonnoj  e-, 
necessary  to  answer  technical  questions  or  to  respond  to  requests  for  „o re¬ 
load  i  r.f  r  rmat  i  on . 

(2)  Computer  system  time. 

(a)  Data  reduction  time  vrf  1 1  be  provided  at  a  nearby  government 
Instal laticn. 

(b)  Stand-alone  installation  time  up  4o  one  hour  during  several 
periods  for  probe  point  attachment  and  validation, 

(3)  Services  of  hardware  vendor(s)  custom, er  engineers.  Project  ABACUS 
will  make  arrangements  for  payment  of  all  charges  Incident  to  such  services. 
Maximum  effort  will  be  made  by  the  PMA  team  to  accomplish  these  actions  durin 
normal  PM  time  to  preclude  unnecessary  costs.  Where  possible  these  services 
will  be  requested  during  normal  preventive  maintenance  periods. 

(4)  Access  to  computer  room*  Project  ABACUS  personnel  will  assist 

the  PMA  team  In  determining  *fhe  best  location  for  the  Installation  of  The 
CSSEA  D-S730  hardware  monitor.  Project  ABACUS  will  arrange  for  PMA  team 
membe-r(s)  access  to  the  computer  room.  All  Project  ABACUS  team  members  will 
have  current  secret  or  top  secret  clearances.  Project  ABACUS  will  assign 
escorts  !o  those  contractor  personnel  (customer  engineer  anr:  software  spec¬ 
ialists  on  an  as  needed  basis)  who  do  not  have  the  required  clearances  a+ 

times  when  it ♦Is  necessary  that  such  personnel  have  access  to  the  Project 

ABACUS  computer  room  to  service  CSSEA  hardware  monitors.’ 

(5)  Work  space  and  support  equipment:  Arrangements  will  be  made  to: 

(a)  Make  available  desk  or  table  space  in  proximity  to  Project  ABACUS 

computer  room  for  two  performance  analysts. 

(b)  Provide  two  tables  (approximately  3*  x  5’  each)  or  carts  with 
equivalent  area,  capable  of  supporting  350  pounds  each,  for  installation  of 
the  CSSEA  D-87CC  hardware  monitor. 

(6)  -Project  ABACUS  will  provide  personnel  to  accept  CSSEA  hardware 
monitor  ant  support  equipment  when  it  arrives  and  help  wiTh  The  insf  a  i  I  a~  1  :>n 
of  this  equipment.  Project  ABACUS  will  also  provide  personnel  to  assist  in 
packing  and  shipping  the  equipment  at  the  completion  of  the  test. 

6.  Insta  I  '  ~<f ' of  probes.  Attachment  cf  hardware  monitor  probes  to  +h« 

DEC  system  will  be  done  only  by  DEC  Customer  Engineer  personnel. 

7.  Cor.stm  I  rts.  Full  realization  of  all  objectives  stated  In  this  Vc-'oro*' ■*:. 
of  Ag  reement  is  contingent  upon  the  success  of  CSSEA,  Project  ABACUS  and  3:13 
personnel  in  locating  satisfactory  points  for  hardware  monitor  probe  attac'^r 
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For  U.S.  Army  Computer 
Systems  Support  and  Analysis 
Agency. 


(iMteM.  4?s 
GtrtALD  B.  DARSuSCH  Q 

HMA  Team  Leader 

Performance  Analysis  Division 
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ANNEX  I 


MEAN 

PROGRESSION 

INDICES 

MANUAL  SELF-PACED 

VS  COMPUTERIZED  SELF-PACED 

(CTS) 

v  >  • 

FIELD  RADIO  REPAIR  COURSE,  MOS  31E20 

>  , 

MEAN  SCORES 

Self 

-Paced  (N*59) 

CTS 

(N=85) 

ITEM 

SEP 

76  -  MAR  77 

JAN 

77  -  MAR  77 

r 

Electronics  Aptitude  (EL) 

116 

110 

General 

Technical  (GT) 

113 

107 

Task 

Hours 

1 

87 

1.00 

.92  (self-paced) 

2 

54 

.48 

.51  (self-paced) 

3 

36 

.70 

.80  (self-paced) 

' 

» 

4 

59 

1.92 

1.86 

5 

69 

.50 

.47 

6 

68 

1.04 

.54 

» 

7 

56 

1.14 

2.11 

s.* 

8 

50 

.38 

.54 

9 

33 

.91 

.29 

10 

25 

1.08 

1.49 

V* 

11 

23 

.36 

.47 

* 

12 

24 

.54 

.32 

13 

24 

.83 

1.32 

14 

45 

.29 

.23 

AVERAGE  OF  TASKS  4  THRU  14  -  .81  .87  ' 
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COMMUNI CAT I VE  TECHNOLOGY  DIRECTORATE 

US  ARMY  TRAINING  SUPPORT  CENTER 

•  vftBT  rncTTc  utrrTMTA  anf.n/, 

|| 

PUBLICATION  LIST 

*.  ■>’’«.  •*-  *■ 

TITLE 

CTD-TR  // 

DDC  ft 

j 

A  Feasibility  Study  of  Computer  Assisted 
Instruction  in  US  Army  Basic  Electronics 
Training.  Feb  68 

(None) 

AD  745  402 

i 

The  Inn! ementat ion  of  Computer  Assisted 
Instruction  in  US  Army  Basic  Electronics 
Training.  Sep  69 

69-1 

AD  704  339 

i 

Audio  Utilization  Conventions  and  Tech¬ 
niques  for  Computer  Assisted  Instruction. 

Mar  70 

70-1 

AD  704  338 

An  Automated  Student  Registration  Pro¬ 
cedure  (REGIS).  June  70 

70-2 

AD  710  983 

» 

A  MACRO  System  for  Computer  Assisted 
Instruction.  May  1970 

70-3 

(None) 

V 

Application  of  Computers  to  Training. 

Apr  71 

71-1 

AD  749  463 

An  Instructional  Model  for  Computer 

Assisted  Instruction.  May  1971 

71-2 

AD  745  409 

■At;.; 

\  .  . 

Instructional  Programming  Guide  for  Com¬ 
puter  Assisted  Instruction.  Jul  71 

71-3 

AD  749  469 

Task  Group  Report:  CAT  Volumes  I  &  TI. 

Apr  72 

(None) 

(None) 

1 

A  Summativc*  Evaluation  of  Computer 

Assisted  Instruction  in  US  Army  Basic 
Electronics  Training,.  May  1972 

72-1 

AD  749  470 

«*•  .  -  * 

Vacuum  Tube/Solid  State  Circuit  Survey 

Mar  73 

73-1 

AD  759  129 

*.***<# 

.*» 

> 

CLASS  I  Language:  Document  A  (Specif. 

No:  S-125-72) .  Apr  73 

(None) 

(None) 

1  V.J 

J-l 
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TITT  r 

CTD-TR  J> 

nor  a 

‘'ecord  Formts:  Bootle  A  (Se-*  if.  No. . 
F-12S-7?).  Anr  7  3 

(No no) 

(N.-ne) 

Concept  Plan:  Booklet.  B  (Specif.  No: 

*i-]  6r  -72)  .  Apr  73 

(None) 

(None) 

Estimated  System  Use  Factors:  Docu¬ 
ment  .  (Specif.  No:  S-l 25-72).  Apr  73 

(None) 

(None) 

A  Preliminary  Instructional  Mod *'3  for  a 
Computer  ‘  r;ed  Training  System.  Jul  73 

7.3-2 

A!)  762  ISO 

An  Do—’.-' -  r-*  r chronics  Graphic--  Svnbol 

So*  for  Vat  P'.&td  'V  System.  Oct  73 

73-3 

A!)  7" A  36 4 

Coe  ••>,» '  ••t.v  Repot  t  Computerized 

Training  System:  Project.  ABACUS.  Aug  73 

7.3-/; 

AJ>  7  77  767 

Prelim  n  -v  Tv> nation  Plan,  for  US  Army 

Com  ’  "  ni eg  System.  Jap  7 A 

74— i 

AD  777  7 S3 

PLATO  it  ; t rr t  Year  Report  Computerized 
Training  Sister.  Apr  7 A 

74-2 

(None) 

?vrvv  <•  "  -  :f  o-  Appj.  ,.o.a.  ions  in  Army 

Tra.  ni-.' 

74-3 

AD  767  4:7 

Second  '’“.at  Status  Ponort  Computerized 
Trainin',  f  Project  ABACUS.  Aug  7' 

.  74-4 

AD  A 03 4 44 3 

Effective  Writing  for  a  Computerized 

Training  System.  Jan  73 

75-1 

AD  A034444 

Computer  Applications  in  Army  Training 

Present  f  .Vo-,  and  Planned  Activity.  Apr  75 

(None) 

(None) 

Tnstrur’  i :  :->i  Effectiveness  of  the  PLATO  TV 
*i  '  !  Pc'?  M/7  v  1  97S 

75-? 

AD  7.074  446 

The  Futu-o  of  f’  e  Computer  in  Amv  Training. 
May  1 c) ;  r‘ 

75-g 

AD  AO 344  33 

Third  A..i;  Status  Report  Computerized 

Training  Systems  Project  ABACUS.  Aug  75 

75-4 

AD  A034501 

Project  ABACUS  Hnn-i 
tation  and  Debuggin 

6  '  on  Program  Docunen- 

g .  Feh  76 

76-1 

AD  A034439 

Course  Development 
Sumnary.  Mar  76 

and  Applications  Programming 

(None) 

(None) 

Report  on  the  Final 
(Comnu  ter  i  r'v1  T'-nin 

Acceptance  Test  for  CIS 
tng  System).  Aug  76 

76-2 

(None) 

The  Test  in;’  of  a  t-’epre^  ion  Model  for 

Predicting  indev  in  Various  Array  Courses. 

Oct  76 

76  -3 

AD  AO 3444 5 

Computer i --  ~r'ioi 
Nov  76 

ng  System  Final  Report. 

76-4 

AD  A03A441 

Fourth  Year  Status  Report,  Computerized 

Training  Systems  Project.,  Project  AP>ACUS. 

76-5 

AD  AO 3 7 34 6 

Aug  76 
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